Papers with Exhaustive ablation studies
Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent attempts at prompt decomposition toward solving complex, multi-step reasoning problems depend on the ability of the LLM to simultaneously decompose and solve the problem. |
| Approach: | They propose a decomposition generator that decomposes complex problems into subproblems that require fewer reasoning steps. |
| Outcome: | The proposed method can produce competitive or even better performance compared to its larger successor, GPT-4. |